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Abstract. The purpose of this article is to expand the number of examples for which the 
complex Green operator, that is, the fundamental solution to the Kohn Laplacian, can be 
computed. We use the Lie group structure of quadric submanifolds of C" x C™ and the 
group Fourier transform to reduce the equation to ones that can be solved using modified 
Hermite functions. We use Mehler's formula and investigate 1) quadric hypersurfaces, where 
the eigenvalues of the Levi form are not identical (including possibly zero eigenvalues), and 
2) the canonical quadrics in of codimension two. 



1. Introduction 

The Heisenberg group in C" is the primary example for which the fundamental solution 
to the Kohn Laplacian can be explicitly written down. The purpose of this article is to 
expand this library of examples to include: 1) quadric hypersurfaces, where the eigenvalues 
of the Levi form are not identical (including possibly zero eigenvalues), and 2) the canonical 
quadrics in of codimension two. It should be noted that does not transform well 
under biholomorphic changes of coordinates. In particular, the fundamental solution to 
in the case of a strictly pseudoconvex quadric hypersurface where the eigenvalues are different 
cannot be obtained simply by rescaling the variables in the Heisenberg case. 

The techniques used in this paper involve representation theory to reduce to a modified 
Hermite equation, where a spectral expansion by Hermite functions provides a quick answer 
to the solvability of This approach has been used by many authors (see for example, 
Peloso and Ricci |PR03] and the references therein). Our work then goes one step further to 
compute a (nearly) closed form expression for the fundamental solution to for the example 
quadrics, mentioned above, by using this spectral expansion together with a modification 
of Mehler's formula. The formulas obtained clearly exhibit the solution operator for in 
terms of the eigenvalues of the Levi form and should make it easier to obtain more precise 
estimates in terms of these eigenvalues. 

In |FS74b] . FoUand and Stein give a formula for the fundamental solution of a family of 
second order operators £q, that include the fundamental solution to the Kohn Laplacian at 
every form level (for which a solution exists). Since Folland and Stein simply present their 
solution and demonstrate that it works, it is not adaptable to many circumstances. On the 
other hand, in |PR03] Peloso and Ricci give a systematic treatment of on quadrics using 
representation theory and Hermite expansions. Our motivation is to use the Peloso/Ricci 
approach but generate formulas in the spirit of |FS74bj . We realized from our earlier work on 
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the Heisenberg group and quadric submanifolds |BR09t IBRll] that we could adopt Mehler's 
formula, one of the workhorse equations with Hermite functions and the Dft-heat equation, 
to the Df, equation. 

Previously to our work, authors attempted to find formulas for the fundamental solution 
to via the Dfo-heat equation or Hamilton- Jacobi equations. In particular, since e"'^'^* 
solves the Dfe-heat equation, if P is the projection onto Ker (□{,), then 

e-'^'il-P) ds 





is the fundamental solution to The difficulty with this approach is that the techniques 
to solve for e"*^'' do so up to a partial Fourier transform in the totally real tangent direc- 
tion. Calin et. al. are able to recover the solution for the Heisenberg group and find some 
formulas for a more general class of quadrics [CCTOGj . The authors are able to use this 
technique to prove estimates on the Db-heat kernel on certain decoupled polynomial mod- 
els in |Rai06[ [Rai07l IRai[ IBRllj . Beals et. al. use an approach through Hamilton- Jacobi 
equations to generate integral formulas for fundamental solutions for certain subelliptic equa- 
tions |BGG96j . Earlier work by Beals and Greiner in this direction used pseudodifferential 
operators |BG88j . 

2. Statement of Results 

In this section, we summarize the type of results we can obtain from our techniques. A 
precise definition of and further background is given in the following sections. 

2.1. Hypersurface Results. We consider the case of a quadric hypersurface in C"^^ of the 
form 

n 

M = {(z^w) G C" X C; Imw = ^(Tj\zj\'^}, aj G R, 1 < j < n. 

i=i 

We shall identify a point {z,w) G M with the point {z,t = Hew) lying in the tangent 
space. The case where all the aj are equal and nonzero is the Heisenberg group, and the 
fundamental solution to on (0, q) forms for l<g<n — lis well known in this case 
( [FS74at IFS74bt ISte93] ). To simphfy the notation of our result, we will (mostly) restrict 
ourselves to n = 2. 

Theorem 1. Suppose n = 2, and M is the hypersurface presented as above with (Xi, (T2 > 0. 
Then, on the space of differential (0, 1) forms, spanned by dzi. Of, is solvable via a convolution 
with a kernel N{z, t) where 

1 (71(72 r'^i-i(ir 



^ Jo (it + Si(r)(Ji|zi|2 + S2{r)a2\z2\^y (1 - r'^0(l " r''^) 
1 (7i(72 r^^-^dr 



^ vr3 7o {-it + si(r)(7i|2i|2 + S2{r)a2\z2\'^y (1 - r''^){l - V^] 

where 



^ji^) = — j = 1' 2. 



1 + r'^j 
1 — f'^j 

In the case of forms spanned by dz2, the factor ofr'^^^^ in the numerator is replaced by r'^^"^, 
and vice versa. 
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The convolution mentioned in the above theorem is taken with respect to the group struc- 
ture on the quadric hypersurface, which is discussed in more detail in the following section. 
In the case where ai = 02 an easy conformal rescaling (which does preserve can be used 
to arrange ai = a2 = I- In this case, the change of variables 

1 + r 2dr 
as 



1 — r (1 — r)^ 

allows one to compute this integral explicitly to obtain 

1 1 

^^^'^^ " 7r3{\z\^ + tt){\z\^ -tt) " 7r3(|z|4 + |t|2)' 

the well-known fundamental solution for the Heisenberg group in C'^ on (0, l)-forms. 

Although we have specialized to the case where n = 2 and aj > 0, it is clear from the 
presentation below that the same techniques can handle n > 2 and aj G M. If one or more 
of the (jj vanish, then the fundamental solution to takes a somewhat different form. To 
simplify the notation, we consider the case n = 3 with one vanishing eigenvalue. 

Theorem 2. Suppose n = 3, and M is the hypersurface presented as above with o\ = 02 = ^ 
and (Js = 0. Then, on the space of differential (0, 1) forms, spanned by dzi and dz2, is 
solvable via a convolution with a kernel N{z, t) where 



dr _ \ 1 

vr^ In I Inrlfl — r 



I In r| 

2.2. Higher Codimension Examples. Here we focus on the case of a quadric of codimen- 
sion two in C^, given by 

M = {{z,w) G X C^; Imw = (j){z,z)} 



where : x i-)- is a sesquilinear form (i.e. (j){z,z') = (l)(z',z)). If the image of the 
Levi form (i.e. 0) is not contained in a one-dimensional cone, then M is biholomorphic to 
one of the following three canonical examples (see Bog91| ): 

• Ml where 4>{z,z) = (l-Zip, 12:2^) 

• M2 where 4'{z,z) = {2Re{ziz^), — |2;2p) 

• M3 where (j){z,z) = (2|zi|2, 2 Re(zil^)) 

The first case. Mi, is just the Cartesian product of two Heisenberg groups in where 
solvability in any dimension is not possible. In the second case, the Levi form of M2 has one 
positive and one negative eigenvalue in each totally real direction. Therefore is solvable 
for (0, g) -forms when q = 0,2, but not q = 1 (see |PR03] ) . In the third case, the Levi form 
of M3 has one positive and one negative eigenvalue for each totally real direction, except 
for one exceptional direction where one of the eigenvalues is zero. Again, is solvable 
for (0, g)-forms when q = 0,2, but not when q = 1 (again see |PR03j ). In the cases where 
solvability is possible, our next theorem provides the explicit fundamental solution. 

Theorem 3. • For M2, the fundamental solution kernel to the Kohn Laplacian \3b for 

q = 0, 2 is given by 

1 1 

^(^'i^) = 4^(|^|4+ |i|2)3/2- 
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For M3, the fundamental solution kernel to the Kohn Laplacian Oh for q = is given 
by 



N{z,t) = - / / a,i9)a2i9) 



JO (1 _ _ 

X 

where 



2dedr 



-i{ti cos^ + t2 sin^) + Ei{e, r)|;zi|2 + E2{e,r)\z2\''f 



ai = ai{e) = 1 + COS0, (T2 = cr2{0) = 1 -cos0, ^j(^,r) = ^^j^ ^^I/^ i = 1' 2. 

If q = 2, then the expression for N is the same except that the factor of r"^~^ is 
replaced by r"'^~^ . 

The integrands in Theorems [1] and [3] are integrable in r and r, 9, respectively when zi and 
Z2 are not zero, and in each case, can be shown to be locally integrable. More detailed 
estimates of these formulas in terms of the volumes of nonisotropic balls of the control metric 
(see |NSW85l INS06] will be given in a future paper. The outline of this paper is as follows. 



Section 3 contains precise definitions of quadrics and their group structure. Section 4 contains 
a brief description of unitary representation theory, which is one of the key tools which allows 
us to transform to a Hermite operator. The basic facts about the spectral decomposition 
of Hermite operators are given in Section 5. In section 6, we explicitly evaluate the spectral 
decompositions in the cases mentioned in the above theorems. 

3. QUADRIC SUBMANIFOLDS AND 

3.1. Quadric submanifolds. Let M be the the quadric submanifold in x defined 
by 

M = G C" X C™; luiw = (t){z, z)} 

where : C" x C" 1— C™ is a sesquilinear form (i.e. (j){z,z') = 0(2;', z)). For emphasis, we 
sometimes write to denote the dependence of M on the quadratic function 0. Note that 
M_<j(, is biholomorphic to by the change of variables {z,w) (-)■ {z, — w). 

3.2. Lie Group Structure. By projecting M C C" x C" onto G = C" x R'", the Lie group 
structure of M is isomorphic to the following group structure on G: 

gg' = (z, t)(z' , t') = [z + z' ,t + t' + 2 Im0(2;, z')) . 

Note that (0, 0) is the identity in this group structure and that the inverse of {z, t) is (—2;, —t). 

The right invariant vector fields are given as follows: let (7 G G; if X is a vector field, 
then we denote its value at g by X{g) as an element of the tangent space of M at g. 
Define Rg : G ^ G hj Rg{g') = g'g] a vector field X is right invariant if and only if 
X{g) = {Rg)^:{X{0)}, where (Rg)* denotes the differential or push forward operator at g as 
a map from the tangent space at the origin to the tangent space at g. Let v be a vector 
in C" ~ M^" which can be identified with the tangent space of M at the origin. Let be 
the real vector field given by the directional derivative in the direction of v. Then the right 
invariant vector field at an arbitrary g = {z,w) & M corresponding to v is given by 

X,{g) = d, + 2lm<f){v,z)-Dt = d,-2 Im <f){z, v) ■ Dt 
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(see Section 1 in Peloso/Ricci |PR03] ) . Let Jv be the vector in R^" which corresponds to iv 
in (where i = v^—T). The CR structure on G is then spanned by vectors of the form: 

Z,{g) = (1/2)(X, - tXj,) = (l/2)(9, - tdj,) - ■ Dt 

and 

Z,{g) = (1/2)(X, + tXj,) = (l/2)(9, + tdj,) + i<P{z, v) ■ A- 
An easy computation gives: 

[Zy, Z^\ = 0, [Z^, Zyi] = 0, [Z^, Z^,] = 2i(f){v, v') ■ Dt. 

The last expression on the right is the Levi form of M as a map from the complex tangent 
space (f G M^" = C") to the totally real directions (spanned by Df). 
For A e C", let 

<p\z,z') = ^{z,z')-X 

where ■ is the ordinary dot product (without conjugation). If A G M*", then (j)^{z,z') is a 
sesquilinear scalar- valued form with an associated Hermitian matrix. Let v^, . . . be an 
orthonormal basis for which diagonalizes this matrix and we write 

where fJ^j, 1 < j < n are its eigenvalues. 

3.3. Special Coordinates. For A G W^, define the function z/(A) by 

u{X) = rank(0^). 

The function z/(A) satisfies < z/(A) < n. We assume the eigenvalues are ordered so that 
/i^, . . . , fJ'l(x) 7^ and fJ'li^x)+i^ ■ ■ ■ i l^n = 0- We identify x with {x\, . . . , x^) and y with 
(y^, . . . ,1/^). We also write z = J2]=ii^j + ior z = x + iy G C". Additionally, we 

let z' = {zi, . . . , z^^x)), z" = {z^(x)+i, ■ ■ ■ , Zn) and similarly for x and y. Although for many 
canonical examples, the choice of coordinates will vary smoothly in A, this is not the case in 
general. 

3.4. Calculations. Let fi, . . . , f„ be any orthonormal basis for C" (later, this choice will 
be a special coordinate basis mentioned just before Section 1X31) . Let Xj = X^., Yj = Xj^., 
and let Zj = (1/2) (X^ — zl^), Zj = (1/2) (X^ + iYj) be the right invariant vector fields 
defined above (which are also the left invariant vector fields for the group structure with 
replaced by —0). Also let dzj and dzj be the dual basis. A (O,g)-form can be expressed 
as "^xex 't'K dz^ where Zg = {K = {ki, . . . , kg) : 1 < ki < ■ ■ ■ < kg < n}. We recall the 
following proposition |PR03t Proposition 2.1]: 

Proposition 4. 

D,{J2<pKdz'')= J2 OLK<pKdz'' (1) 

where 

Olk = -SlkC + Mlk (2) 

and C is the sub-Laplacian on G: 

n 

C = (1/2) Z^Zk + Zj^Zk 

k=l 
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and 



eiK,L)[Z„,Zi] zf\KnL\=q-l 

otherwise. 

Here, e{K, L) is (— 1)*^ where d is the number of elements in KdL between the unique element 
k & K — L and the unique element I E L — K . 

The above proposition is stated and proved in |PR03] for left-invariant vector fields. If 
right invariant vector fields are used, then the above proposition provides a formula for Ob 
associated to M_^. 

For later, we record the diagonal part of i.e., Dll. Using ^ with L = K and the 
above formulas for Z^, we obtain 



fc=i VfceL fc^L / 



(3) 



For the case of on the Heisenberg group, (t){z,z) = \z\'^ and Zk = D^^ — i'ZkDt- In this 
case, is a diagonal operator (since = when k ^ I) and the above formula for 

Dll gives the coefficient of acting on forms of the type (j)L{z)dz^. 
We will also need the adjoint of D^k, which is defined as 

/ DLK{f{z,t)}g{z,t)dxdydt = f{z,t)Df^{g{z,t)}dxdydt 

J{z,t)€G J{z,t)eG 

(note: this is the "integration by parts" adjoint, not the adjoint, since there is no conju- 
gation). An easy computation shows 



= -^1^ [^'^ + j - M 1. ■ A - 2. Hvk, V,) -DA. (4) 

k=l \k£L k<^L / 

Note the minus sign instead of the plus sign in front of the imaginary term at the end. For 
later use, note that 



k=l \k£L k<^L / 



U,, = nfl and □z.l{/(-^, -t)} = (□fi/)(-^, -t) (5) 
for any smooth function /. 

4. Representation Theory. 
4.1. Unitary Representations. 

Definition 5. For a Lie group, G, a unitary representation is a homomorphism vr from G 
to the space of unitary operators on L'^{W^ ) for some n' > 0. 

For our quadric Lie group G, we will fix A G as above and take n' = z/(A) (the 
number of nonzero eigenvalues, /ij' as in Section IX^ . Suppose z^ = z = x + iy G C"" is the 
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special coordinate system mentioned in Section Let t, X E M"^ and G For 

g = {x,y,t) e G, define 7ix,r,{x,y,t) : L\W^^^) ^ ^^(M^W) by 

7rA,,(x, t)(/i)(0 = e*(^-*+2R^(-"-^))e-2^E;=i /^^i + 2a;') 

for h e L2(M^(^)) (so ^ G M''^^)). Note that if = C + k, then Re{z" ■ r/)) = x" ■ C + y" ■ It 
is a straight forward computation that vr is a representation for G. For further background 
information on representation theory (in particular for the Heisenberg group), see |Tay86| . 

If X is a differential operator on G comprised of right invariant vector fields, then we can 
compute how X "transforms" via 7rx,r] to an operator on L'^(W^^^) denoted by d'Kx,r)X^ which 
means that 

Xgi-r^^riig)} = dnx,nX o 7Tx,n{g)- (6) 
In words, the Xg on the left side differentiates tt x^nig) with respect to the variable g whereas 
on the right side, d'Kx,riX is an operator on L?' {W'^^'>) . The next proposition identifies dTtx,r){X) 
for our basis of right invariant vector fields of G. 

Proposition 6. For the right invariant vector fields, Xj, Yj, Dt^ defined in the last section, 
the following identities hold as operators on L'^iW'^'^^): 



xA^.^Kg) = d.xr,x, = 2^^^ °-^-(^) 'f ^ ^ ^(^) (7) 

Y,{.xr,}{g) = d^x.Y, = ^ (8) 

Dtk{'^\r^]{g) = d7rx,rjDt^ = i\k o nx-nig) 1 < k < m. (9) 

Remark. If we had used left invariant vector fields instead of right invariant vector fields, 
then the order of the operators on the right would have been reversed (i.e. the D^. would 
appear on the right of nx^nig), etc.). See, for example |PR03l equation (8)]. We prefer the 
above ordering of the operators on the right and therefore have chosen to use right invariant 
vector fields. 

Equation ([9]) is immediate. Equations ([7]) and ([8]) are easily shown to hold at the origin, 
g = 0, since Xj{0) = D^^ and ^^(0) = Dy^^ then use right invariance to conclude these 
equations hold at all (7 G G. 

Now we compute the "transform" of Dlk and its adjoint, via dnx,r], using ([3]) and (jl]). 
Note that the coordinates {z^, . . . , z^) were chosen to diagonalize the form (f){z, z) ■ A with 
eigenvalues /i^. This observation, together with formulas (JTj), ([H]), and ([9]) easily establish 
the following proposition 



Proposition 7. 

\ ifK^L 



(10) 







if K = L 
ifK^L. 



Note that Dlk and its adjoint transform to operators that only differ by a sign change in 
the zeroth order terms involving the fij. 

4.2. Group Fourier Transform. For {z,t) G G and fixed A G M™", we express {z,t) = 
{x, y, t) = {x', y', x", y", t) = (x', y', z", t) as in Section [3l3l The coordinate z" may be thought 
of as in C"-^(^) or -R^i'^-^W) , 

For an integrable function / : G C, we define the group Fourier transform of / as the 
operator -K^'^'if) : ^^(M^W) L2(R^W) where for h G L2(R'^(^)), 

^''n/){M(0= / f{z,t)7^^,,{z,t){hmdxdydt 

J {z=x+iy,t)^G 

As before, the coordinates for x, ?/ G M" relative to the basis v^,. . . , v^. 

The following proposition (see [BRlll equation (12)] relates the group transform to the 
usual Fourier transform and easily follows from the definition of tt^'"^. For us, the usual 
Fourier transform on M"^ and the notation that we use to denote it is 

/(o = m = j^m) = £ e-"-«/(x) dx. 

Proposition 8. For ^ G W^^^ and h G ^^(M'^W), 



= (27r)(2"+™-KA))/2 f J-,„,,,,{/(x, y, t)e-2^^.-'' ^'^^^^ }(x', 2/0^, -2r], -X)h{^+2x') dx' . 

(12) 

where J^x",y,t indicates the Fourier transform in the {x",y,t) variables (but not x' ) and where 

fl^O^= (^1^1, . . . ,/i^(A)^^(A)). 

As with the classical Fourier transform, the above process can be reversed to identify 
/ G L'^{G) from its group Fourier transform. To see this, assume that T^^'^{f) is known as 
an operator on L?'{W^-'^^) and we wish to identify /. For each a G M'^'^'^^ define ha{C) = 

(27r)-"-"^/2g-ifa_ gg^ 

«^'na,0 = ^''''(/)(M(e). 
The above definition needs justification since ha ^ L?'{Ey). However, we can multiply ha 
by an increasing sequence of cut-off functions (approaching 1 everywhere) and then take 
the limit as our definition of the left side. This technique is carried out carefully in |BR11[ 
equation (16)]. Using f|T2|) . we obtain 

w^'^a, = ^Y\ham = T {/(x, t)e-^'^tl | (2a, 2/ o -27^, -A)e-*«-^ (13) 

where T is the Fourier transform in all variables. The motivation for the choice of h = ha is 
that it offers the "missing" exponential needed to relate the full Fourier transform / with m'^'''. 
By inverting the Fourier transform appearing in (JT3l) . we obtain the following proposition. 
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Proposition 9. Lei M'^'^ (a, 6) = M ^' 2^{a/2,b/(2fi ^)) whereh/ {2ji ^) is the vector quantity 
whose jth component is bj/{2fij^). Then 

fix', y', fj, A) = e-2'^^-'i "^"''''J^;} (^e-^ ^^'=1 "^'^/'^^'^^'''(a, 6)) (x', y') (14) 

where f{x',y',r],X) is the Fourier transform of f in the variables r] and A (but not x' and 

y')- 

We can further recover / using the inverse Fourier transform in the r], A variables provided 
that the orthonormal basis f ^, . . . , f^, which diagonalizes 0^, depends continuously on A (as 
it does in the examples to follow). 

4.3. The Transformed We start with a general proposition which describes how right 
invariant operators transform via the group transform. 

Proposition 10. Suppose X is a differential operator of order at least one which is comprised 
of right invariant vector fields. Let X"-'^^ denote the "integration by parts" adjoint of X : i.e., 
for fi G Dom(X) n L\G) and /a G Dom(X'^'^^) n L\G), 

Xfi{g)f2{g) dg= [ f\{g)X^'=f2{g) dg 

g&G JgeG 

where dg = dx dy dt . Then 

dn,,,{X^'^)on''\f)=n''^{Xf). 
Proof. Uhe L\W^^^), then 

TT^'^iX f){h) = [ Xf{g){7r,M){h) dg 

JgeG 

f{g)Xf{7TxM)ih)dg 

gdG 

f{g)diT,^,{X^''^)o{7r,^^{g)){h)dg 

gdG 



rf7r,,,(X^<ij){ / f{g)T^^,Mmdg] 



which establishes the proposition. 

We shall apply this proposition to using ( ITT]) (note that the off-diagonal terms trans- 
form to zero). We are interested in finding the the operator which satisfies the equation 
Dll ° Ni = I — Pl, where Pl ■ L'^{G) — )■ L^{G) is the orthogonal projection onto the 
Ker(nii). For now, we will fix the index L. The operators and Pl are given by group 
convolution with functions, denoted by N{z, t) and P(z, t), respectively. So we are interested 
in solving □llA^(z, t) = 6{z, t) — P{z, t) where 6 is the Dirac delta function supported at the 
origin. 

Corollary 11. nLLN{z,t) = 5{z,t) — P{z,t) if and only if 

dnx,r,{aif){7i''m) = I - p''"^ (15) 
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as operators on L'^{R^'^^^), where P^'"^ is the projection onto the kernel of dn'^'^ (O'^i) . 

Proof. We apply Proposition [TO] to Dll. Let h G L'^{W^^^^). The existence of N solving 
DLLN{z,t) = 6{z,t) -P{z,t) implies: 

d7rx,r,{nfi)7r^^m{h) = [ nLL{N{z,t)}7rx,r,{z,t)hdzdt 

{5{z, t) - P{z, t))TTx,r,iz, t)h{^) dz dt 

(z,t)eG 

= Ki)- I P{z,t)nx,r,{z,t)h{^)dzdt 

(since vr;v,»;(0,0) is the identity operator). We further claim that the integral on the right is 
the same as the projection of h onto the Ker (^dTTx^r^iD'^i)^ This is established by proving 
the following: 

(1) d7Cx,,{al^l){j\^^,)^cP{z,t)7Tx,,{z,t)h{Odzdt^=0foT ^11 h E L\G) 

(2) if he L^{G) is orthogonal to Ker {dnx^viofl)) , then 



/ P{z,t)7ix,r,{z,t)h{^)dzdt = 0. 

J(z.t)&G 



'{z,t)eG 

The first fact is an easy consequence of Proposition [TDl To establish the second fact, it is 
enough to show 



/ P{z,t)7Tx.r,{z,t)h{0dzdt , g{0) =0 

\J{z,t)GG I ^ 

for all g belonging to the Ker [d-n x,r)^^^^i)) ■ We have 



P{z,t)Tix,riz,t)h{i)dzdt , giO) ={hiO, / P{z,t)7r*x^{z,t)g{0dzdt 

{z,t)(iG / ^ \ J{z,t)(iG I ^ 

Since h is orthogonal to the Ker [dix x,r]^^^^i)) ■, it suffices to show 

d7rA,,(nfi) ( / P{z,t)'nl^{z,t)g{i)dzdt\ = 0. 
lJ{z,t)eG J 

Now TTx^^{z,t) = nx^ni—z, —t), so after a change of variables, the left side becomes 

d7rA,,(nfi) ( / P{-z,-t)7ix,rj{z, t)g{0 dzdt] 
lJ{z,t)eG ) 

= I Pi-z,-t){nflnx,,{z,t))g{Odzdt 
Jiz,t)eG 

= [ P{z,t){nfl7Tx,,)i-z,-t)giO dzdt. 
J(z.t)eG 
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A chain rule calculation shows that {D'^lf){—z, — t) = z, — t)} (recall ([5])). There- 

fore, we can integrate by parts to show that the right side equals 

f nfl{Piz,t)}Trx,,i-z, -t)g{0 dzdt. 



Since D^*^ = Dll, the above term is zero, as desired. This proves the second fact and 
establishes f llSp . The converse can be established similarly. 

5. The Hermite Operator 

Our starting point is equation Corollary [TTl which allows us to transfer the analysis of 
Dll to the following operator equation 

where according to (fTTj) . 

The operator on the right is a modified Hermite operator which has a well known spectral 
decomposition which we now describe. On the real line, and for ^ a nonnegative integer, 
define the Hermite function 

Each ipi has unit L^-norm on the real line and satisfies the equation 

(see Thangavelu's book |Tha93] ). The Hermite operator, —D^x + is a nonnegative, self- 
adjoint operator and the ipi, £ = 0, 1, . . . forms a complete orthonormal basis of eigenfunc- 
tions with eigenvalues 21+1. In several variables, we let ^ = (£i, . . . , d-vi^x)) where each £j is 
a non-negative integer. For each A G -R™ \ {0}, define 

Each has unit L^-norm on M and hence '^^ has unit L^-norm on R'^*^'^\ An easy 

calculation shows that 

i-D^^^^ + {f^jQ'K^im = {2i, + i)<.(e,) 1/^,1. (16) 

Therefore 



where A,^'" = ^(2£, + + ^.^^ - J] + 

j=i \jeL j^L J 



V\ 



j=i \jeL j^L 

The collection of functions ^^£(1^) form a complete set of orthonormal eigenfunctions for 
dnx^T^iPi^^l) with eigenvalues A^'''. Note that A^''' > for all i and A^''' > for all nonzero 
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multiindices ^. When £ = 0, Aq''' can equal zero only if = 0, all the yU^ < for A; G L, 
and all /i^ > for k ^ L. This cannot occur if either the number of negative eigenvalues 
is not equal to g=length of (L) or if the number of positive eigenvalues is not equal to 
n — q. This condition is the hypothesis of the first part of the following solvability theorem 
in Peloso/Ricci |PR03j . 

Theorem 12. (1) (Theorem 1 in [PR03] ) Suppose \L\ = q. If the number of negative 
eigenvalues of ip^ is not equal to q or if the number of positive eigenvalues of (p^ is not 
equal to n — q, then the Ker {dTix riiP^'i^L)) = {0} its inverse is given by the operator 

where is the orthogonal projection onto the space spanned by ^E'^(0- 
(2) (Theorem 5.2 in |PR03] ) Suppose z/(A) = n (so there is no t]); if < for j E L 
and fi'j > for j ^ L, then Ker (^diTx^rjiO'^i)^ is the space spanned by 

n 

In the first case of this theorem, we will use Proposition |9] to identify N{z,t) (or at 
least its t- Fourier transform) by applying the the operator 3^'^ to the function ha{^) = 
(27r)~"~'^/^e~*^ ", as in the discussion leading up to Proposition O The first step is to 
compute 

i&i^ '^i. i=i 

where Z" is the set of n-tuples of nonnegative integers and where P^"^ is the orthogonal pro- 
jection onto the space of 1? functions in the variable spanned by ipg.i^j)- Each projection 
term on the right is 




where the last equality uses a standard fact that a Hermite function equals its Fourier 
transform up to a factor of {—iY^ (see |Tha93] ). Substituting this expression on the right 
into the above expression for u'^'^{a,^), we obtain 

e j=i 

(17) 

In view of f ll4p . to compute N{x',y',ri, A), we need to determine 

M^'^(a,6) = u-^'-^\a/2,b/{2fi~^)) 
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where h/ (2fi is the vector quantity whose j'th component is bj/ (2/i^- From the previous 
equahty, we have 

£^zi ' ^ j=i 

Using f|T^ . the formula for the partial transform of is given in the following proposition. 

Proposition 13. The partial {z", t)-Fourier transform of the fundamental solution to Ol is 
given by 

N{x\ y', fj, A) = e-'' ^^-'^ '"^"'"'J^'l (e't Eji'i "^^^/^'M^'^(a, 6)) (x', y') (19) 

where ■u^''^{a,b) is given in l[T^) . 

In subsequent sections, this formula will be explicitly computed in the examples mentioned 
in the introduction. 

In a similar fashion, the Szego operator, P, representing the projection onto the zero 
eigenspace in the second case of Theorem [12] can be computed. We obtain the following 
result. 

Proposition 14. Suppose z/(A) = n (so there is no rj); if fij < for j G L and fij>0 for 
j L, then the operator representing the projection onto the zero- eigenspace of Hi is given 
by a (group) convolution with the kernel P{z,t) whose t-Fourier transform is given by 

n 

P{x,y,X) = (27r)-("+™/2) J]|/iJ|e-l^'lH+^.'). 

j=i 

This can be easily inverted using the inverse Fourier transform in A to recover the classical 
formulas for the Szego kernel. 

6. Calculation of N 

6.1. Reductions for the General Case. Our goal is now to try to unravel the formula 
fin?]) for N{x,y,r], X) under the hypothesis in the first part of Theorem [T^ The discussion 
in this section will apply to the general case. Subsequent sections will address the specific 
cases given in Theorems [1] and [31 
We rewrite ( ITQil as 

N{z',r],X) = (27r)-5(2"+— W)e-2^E"=iA''-.%- 

Here, we are using the following notation for the one-variable Fourier transform: 

^^'^9)iy) = j^, J jib)e^''db 
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and similarly for ^{^g)[x). We compute the above partial inverse Fourier transform ex- 
pression in af 

= 4|/x| J--i|v'£^.(a)^,^ (a - 2^y) |(2|/i|i/2^) 

= 4|^| (-l)^^^-i 1^^,^ (a)^{e^'^'>,^. (a) } | (2|/i| V^^;) 



V 27r Jr 

V 27r 

Thus, we have the following lemma. 

Lemma 15. In the first case of Theorem ITB where the eigenvalues, A^'^ , are nonzero for 
(—^\W "'^^^ r 



where 

j=l \k£L k^L / 

6.2. The Case when the Eigenvalues have the same Absolute Value. In this section, 
we assume v{X) = n (so there is no rj variables) and that all the /ij" have the same absolute 
value, for each A G M™. In this case, we can rescale and assume 

l/uj"! = |A|, for all 1 < j < n 

and write 

/ij = o-^^|A| where = ±1. 

This assumption, though restrictive, will allow us to recover for the Heisenberg group, as 
well as for the case of M2 with real codimension two, given in Theorem [31 We will further 
assume there are no zero eigenvalues as in the first case of Theorem [121 In this case, we have 

n 

Aj' = 2iJ2^, + J)\M 
i=i 

where J = J(A) is a positive integer. In the case of the Heisenberg group with (j){z, z) = —\z\'^ 
and L is an index of length q, then J = g if A < and J = ?2 — gifA>0. Ifl<g<ri — 1, 
then J is a positive integer. 
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From Lemma [T5| can be written as 

(20) 

where 

'^t{t) = ipeiih) ■ ■ ■z/'£„(t„) and ax = (a^Xi, . . .,a^Xn). 
Now we use Mehler's formula (see |Tha93] ). for each fixed x, ?/ G 

oo 

k=o \e\=k 

where 



7r"/2(l - r2)'^/2 

The key idea is to now multiply Mehler's formula by r'^^^ and integrate r over the interval 



< r < 1: 



E E = / r^- V(-r) dr. 



A:=0 \e\=k 

Note that there is no problem with convergence of the integral on the right since J is a 
positive integer. Applying this formula to fl20|) with x replaced by a and y replaced by 
2|A|^''^a; — a gives 

iv(^.A)= '^"'';;!;:i"|"'' e"'--''i-' 

^e-2i(.„a)|A|'»g-(S)l^l-'e-(iS)(l*l""-»)» dadr. 



'aeK" Jo 

Now integrate out a (completing the square in the exponential, etc.) to obtain 

If 2; 7^ 0, then the above integral converges. Now set s = (1 + r)/(l — r) and then translate 
s by one unit and we obtain the following lemma. 

Lemma 16. In the case where J > 0, as above 

/"OO 

N{z, A) = (27r)-"-t2"|Ar-^ / s^-\s + 2)"-^-ie-(^+^)l^ll"l' ds. 

Jo 

This integral can be computed using integration by parts. can then be computed using 
the inverse Fourier transform in the A variable, provided the coordinates from Section 
13.31 vary continuously in A. In the Heisenberg group (where (j){z,z) = — |2;p), the classical 
formulas for A^ (see |Ste93] ) can be determined by computing the inverse Fourier transform 
in A and separating out the integral over A > 0, where J = q and A < 0, where J = n — q. 
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6.3. Proof of Theorem [3] for M2. For A G let 0^ : x ^ M be defined 
by (j)^{z,z') = (f){z,z') ■ A where is the defining function for M2 given in Theorem [3l 
It is easy to compute that the Hermitian form associated with 0'^ has two eigenvalues: 
fii = |A| and = — |A|. For A = |A|(cos6',sin^) G M^, the associated eigenvectors are 

^1 = 75 (7™' = ^ (-v^r^^, respectively. These 

eigenvectors vary smoothly with 9. 

Since the eigenvalues have the same absolute value, we can compute using the techniques 
in the previous section. Solvability of is expected for (0, g)-forms where q = 0,2, but not 
for q = 1. For both g = 0, 2, = 2{ii + £2 + 1) and so we can use Lemma [TBI with J = 1 
to compute 



Using the inverse Fourier transform in t G M^, we obtain 



Polar coordinates can be used to reduce the above integral to 

1 de 



N{z,t) 



47r4|z|2 7o dzl"^ -i{ti cos 6 + t2 sin e)y 



The above integrand is periodic in 6. A shift in 6 (specifically, — A where cos A = ti/\t\ 

and sin A = ^2/!^!) can be used to reduce the denominator of the integrand to (l^;^ — 
i{\t\ cos9)y. From here, a residue calculation (or Maple) gives 

N{z,t) 



27r3(|2|4+ |t|2)3/2' 

as stated in Theorem [31 This concludes the proof of the first part of Theorem [31 The second 
part (for M3) will be given after the next section where we introduce techniques for handling 
eigenvalues which are not equal in absolute value. 



6.4. Proof of Theorem [Tl Here, n = 2 and the multiindex L = (1, 0). The eigenvalues are 
/i^ = (TiA, ^2 = "^2 A with o"i, (J2 > 0. We first consider the case when A > and we obtain 

= 2{ii\fii\ + (£2 + l)\fi2\) = 2A(£iai + (£2 + 1)^2) 

(in this case, there is some cancellation in /xi-terms in the formula for A^'^ but not in 1x2)- 
From Lemma [151 the operator becomes 

\^^) ' t^l ^^^^ + (^2 + 1)0-2) Ja&? 

where 

2 

E{a, X, y. A) = n {2af\^l^x, - a,)e-^''')'"y^^^^"\ 
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This time, we use Mehler's formula with fractional powers of r: 

4/2 



1^ 1 



n (1 _ ^2a,)l/2' 

i=i 



where Xj, Yj G M. Multiplying this expression by r'^^ ^, integrating from r = to r = 1 
and setting Xj = aj and Yj = 2A^/^crj''^Xj — Oj, j = 1, 2, gives 



- aj)e 



1 /"^ ,^'^2-1 ^ . l+r"] 1 l-r^j/^^/J 1/2 n2 n- 1/2 ,1/2 

71- (1 _ r2^i) 1/2(1 _ r2'^2) 1/2 11 

We then integrate out a G (completing the squares in the exponent, etc.) and simplify 
to obtain 

When A reverses sign, then so do the fij. As a result, the /Zg cancels instead of the fi^ in 
the expression for A^^. The above computation goes through unchanged except that r'^^~^ 
replaces r'^^-i g^j^j |^| replaces A. We then obtain 

N(z,X) = - — A 0-10-2 / r- e ' ' dr. 

^ (27r)5/2i ' ' (1 - ^^"0(1 -^''') 

We can evaluate the inverse Fourier transform in A by computing two integrals: one where 
A > and the other where A < 0. After a simple integration by parts we obtain: 



TT^ Jo {it + si{r)ai\zi\'^ + S2(r)o-2|-22P)^ (1 - r''^){l - r"'^) 

0-10-2 



1 a^ao r^'^-^dr 



TT^ Jo {-it + Si(r)o-i|zi|2 + S2(r)o-2|z2p)^ (1 - r"^){l - r<'^) 
where 

1 + r'^i 

Sj{r) = for 7 = 1, 2. 

This completes the proof of Theorem [H 

Remark. The same process can be used to evaluate N{z, t) in cases where n > 2 or where 
the eigenvalues of the Levi form (the aj) have both positive and negative terms. 
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6.5. Proof of Theorem [2]. The quadric hypersurace of interest in Theorem [2] is 



M = {{zi,Z2,Z3,w) gC^ Rew= \zi\^ + \z2r}. 

Note that this quadric has a Levi form with diagonal entries 1, 1, corresponding to the 
directions zi, Z2, z^, respectively. The (0, 1) forms under consideration are spanned by dzi 
and dz2 (but not dz^). Our starting point is the formula for N{x', y', rf, A) given in Lemma [T5] 
with n = 3, m = 1, z/(A) = 2. In addition, z' = x' + iy' = {zi, Z2)', f] is the Fourier transform 
variable associated to the zero-eigendirection variable 2:3; A is the Fourier transform variable 
associated with t = Rew; and /i^ = = ^- We therefore have 

A-^'-^/2^2|A|(|£| + l)+ '''' 



4 

(note that the term 'Ylij&L f^j ~ '^j^L /^i ^^^^ since /i^ = A, j = 1, 2 and one of these indices 
belongs to L and one does not). 
By Lemma [T5l 

■-If 

\e.\=kj 



Now the idea is to write 
(-1)'= 



2|A|(A: + 1) + H74 2|A|(A: + l + §i^) 2|A| 



\-lfr^+^-Sk dr. 



The computations in the previous section (using Mehler's formula and integrating out a) 
can then be repeated with minor modifications to show the following formula for N[z\ fj, A) 
which is analogous to fl22|) : 



Note that the above expression is a Gaussian in 7] and so its inverse Fourier transform in 
r] is easily calculated: 



N{z',Z3,X) 



32IA 



2 /•! 



(277)7/2 |lnr|(l -r)2 
The inverse Fourier transform in A is now easily calculated: 



|A|(k'P(i^^) + |.3pp^) 



N{z,t) = - / — — r^Re 

TT* Jq I lnr|(l — rj^ 




which establishes Theorem O 
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6.6. Proof of Theorem d for M3. For A G let 0^ : x ^ R be defined by 
(j)^{z, z') = (f){z, z') ■ A where is the defining function for M3 given in Theorem |3l We write 
A G in polar coordinates A = |A|(cos6', sin6'). It is easy to compute that the Hermitian 
form 0^ has two eigenvalues: fii = |A|(cos6' + 1) and = |A|(cos6' — 1). The associated 

eigenvectors are = ^ ( vi-cLe ' Vl - cos 9^ , and = 75 (^-Vl - cos 6*, 7==) , which 
vary smoothly in 6. Since the eigenvalues have opposite sign for all 6 except = 0, we expect 
solvability of on (0, g)-forms for q = 0,2. We first assume g = 0. We see that 

= (2£i + 1)1^^1 + (24 + + /i^ + /i^ = 2|A| ((£1 + + i^a^) 

where cxi = (1 + cos6') and (T2 = (1 — cos 6'). Repeating the same arguments from the last 
section, we obtain 

2 



iV(. A) = ^ r n e-l^l^^-^l^^l^ dr 



We now take the inverse Fourier transform of this expression in A G using polar coordi- 
nates. Integrating |A| from to infinity is a straight forward integration by parts. However, 
the 6 and r integrals cannot be evaluated in closed form. The result is 



N{z,t) = - / / a^{e)a2{e) 



Jo Jo ^(1 _r'^i)(l _r'^2) 

2d9dr 



X 



cose + tasin^) + E,{9,r)\zi\-' + E2ie,r)\z2\^f 



where 

(Ti = ai{e) = 1 + cos^, (T2 = a2{0) = 1-cos^, Ej{e,r) = ^-^j^ J = 1, 2 

as stated in Theorem [3l In the case where q = 2, A^^'*'^^ becomes 2|A| {liai + (£2 + l)c"2)- 
This change results in a factor of r'^^"^ in the numerator of N instead of the factor of r'^^^^. 
This completes the proof of Theorem [3l 
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